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Abstract 

Many teachers resort to using reprimands in attempts to stop disruptive student behavior, 
particularly by students with emotional or behavioral problems, though this may not be effective. 
This study examined short-term longitudinal data on teacher reprimands of 149 teachers in 19 
different elementary schools across three states, as well as disruptive behavior and classroom 
engagement of 311 students considered at risk for emotional and behavioral disorders. A cross- 
lag analysis showed that teacher reprimands did not decrease students’ future disruptive behavior 
or increase their engagement or vice versa. While teacher reprimands may suppress misbehavior 
momentarily, they do not appear to be effective in decreasing students’ disruptive behavior or 
increasing their engagement over time. Limitations and implications are discussed. 

Keywords: teacher reprimands, student disruptions, student engagement, elementary 


school 
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“Stop Doing That!”: Effects of Teacher Reprimands on 
Student Disruptive Behavior and Engagement 

Students with emotional and behavioral disorders (EBD) experience many challenges in 
school. The literature has identified common characteristics of students with or at-risk for EBD, 
including aggression, attention and academic problems, antisocial behavior, low classroom 
engagement, high rates of disruptive behaviors, and mental health challenges (Caldarella, Larsen, 
Williams, Wills, & Wehby, 2019; Conley, Marchant, & Caldarella, 2014; Salle, George, 
McCoach, Polk, & Evanovich, 2018). These characteristics, in addition to disrespect and 
hyperactivity, were reported by elementary teachers as common behavior problems observed in 
their classrooms (Conley et al., 2014). Teachers also report that students at risk for EBD share 
many of these characteristics, as well as frequent noncompliance with teacher directions (Hecker, 
Young, & Caldarella, 2014). 

The ways in which teachers and students interact can impact outcomes for students with 
EBD. For example, teachers' struggles to manage classroom behavior may be related to these 
students’ negative academic outcomes (Caldarella et al., 2019). Teachers report feeling 
unprepared to implement effective strategies to serve at-risk students, particularly those with 
emotional or behavioral problems (Chafouleas, Volpe, Gresham, & Cook, 2010; Reinke, 
Stormont, Herman, Puri, & Goel, 2011). Student-teacher relationships can also be more 
challenging for students with EBD, as they often refuse to follow directions, engage in 
defiant/non-compliant behaviors, or ignore their teachers in a passive-aggressive manner (Hecker 
et al., 2014). However, there can be positive outcomes if the teacher-student interactions are 
positive. For example, teacher student relationships can be improved by simply giving students a 


personalized greeting each day (Allday & Pakurar, 2007). Further, with such personalized 
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greetings, teachers have been able to increase the on-task behavior, or engagement, and decrease 
disruptions of students in their classrooms (Cook et al., 2018). In addition, teachers who deliver 
low rates of negative feedback (e.g., reprimands) and high rates of positive feedback (e.g., 
praise) may be particularly effective with students with EBD when providing multiple teaching 
and learning opportunities that enhance students’ engagement (Rathel, Drasgow, Brown, & 
Marshall, 2014). 

Reprimands 

Reprimands, often intended as a form of punishment, are statements meant to correct 
misbehavior (Allday et al., 2012) and to decrease the probability or frequency of the behavior 
they follow. Reprimands have also been referred to as negative communication (Rathel, 
Drasgow, & Christle, 2008) or contingent punishment (Merrell, Ervin, & Gimpel Peacock, 
2012). Reprimands are noted as being less effective than positive behavioral classroom 
management strategies (Reinke, Herman, & Stormont, 2013). Students with or at risk for EBD 
appear to become more engaged and less disruptive when they receive less frequent teacher 
reprimands and more frequent teacher praise, responding more powerfully to these strategies 
than their typically developing peers (Downs et al., 2019). 

In elementary school classrooms, reprimand rates have been observed to be higher than 
praise rates (Reinke et al., 2013; Van Acker, Grant, & Henry, 1996) and tend to increase as grade 
level progresses (Reddy, Fabiano, Dudek, & Hsu, 2013; White, 1975). However, in one study, 
while students at-risk for EBD received approximately equal rates of praise as their peers, they 
received a significantly greater number of reprimands, thus creating an unfavorable praise to 
reprimand ratio (1:1.92 for at-risk students compared to 1:1.43 for peers; Caldarella et al., 2020). 


In a study by Downs et al. (2019), students with emotional and behavior problems received 


EFFECTS OF TEACHER REPRIMANDS 6 


reprimands at a rate of 0.10 per minute (SD = 0.07) compared to their peer comparisons who 
received 0.04 reprimands per minute (SD = 0.05). 

Teachers often respond to disruptive student behavior by increasing their use of 
reprimands (Hollingshead, Kroeger, Altus, & Trytten, 2016), which may temporarily stop 
misbehavior (Alber & Heward, 2000). If misbehavior stops, the teacher’s behavior (i.e., 
reprimanding) is reinforced and teachers continue to utilize reprimands (Shores, Gunter, & Jack, 
1993). While reprimanding may be less effective in the long term, teachers may continue to 
engage in reprimands for a variety of reasons including lack of training/professional 
development, constraints on time, or burnout (Jennings & Greenberg, 2009) in addition to 
personal reinforcement. 

From an operant framework (Skinner, 1938), the application of an unpleasant stimulus 
results in a decrease in the behavior it follows. Thus, reprimands would be predicted to decrease 
student disruptive behaviors, if applied consistently and if reprimands are experienced as an 
unpleasant stimulus. The antecedent of student misbehavior may result in the behavior of teacher 
reprimands, the consequence of which may be decreased student misbehavior, thus reinforcing 
teacher reprimands. There is however the possibility that students may engage in disruptive 
behavior in order to obtain teacher attention, be it positive or negative attention, resulting in 
reinforcement of disruptive behavior (Martens & Ardoin, 2010). Another consequence of teacher 
reprimands could be to decrease student disengagement, potentially resulting in increased student 
engagement. These hypotheses can be tested using a cross-lag model (Kenny, 1975) where 
teacher reprimands, student disruptive behavior, and student engagement at time ¢ are regressed 
on those same measures at time ¢ - 1, allowing for any causal impacts of teacher reprimands, 


student disruptive behavior, and student engagement on each other to be isolated. 
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Research shows mixed effects of teacher reprimands on student behavior (see overview 
by Gable, Hester, Rock, & Hughes, 2009). For example, a small study during a summer school 
with 18 students with behavioral and academic difficulties (Sherrill, O’ Leary, Albertson-Kelly, 
& Kendziora, 1996) found that the more consistently the teacher reprimanded, the less disruptive 
students were (specifically regarding callouts). This study showed that consistent reprimanding 
did not negatively affect overall participation or hand-raising. However, other researchers have 
found that teacher reprimands can cause students to engage in verbal or physical aggression (Van 
Acker et al., 1996) and escape-motivated behaviors (Shores et al., 1993), such as acting out in 
order to be removed from the classroom during math instruction due to low math ability. More 
recent findings have also suggested potentially negative outcomes associated with the use of 
reprimands including positive correlations with students' problem behavior (Downs et al., 2019; 
Kodak, Northup, & Kelley, 2007) and teachers' emotional exhaustion (Reinke et al., 2013), and 
negative correlations with students’ on-task behavior or engagement (McComas et al., 2017). 
However, there is a lack of longitudinal studies examining the impact of teacher reprimands on 
student disruptions and engagement. Given some differences between past research findings, as 
well as the lack of predictive studies using longitudinal data, further evaluation of the effects of 
reprimands on students’ classroom behavior is warranted to help fill a gap in the literature. 
Study Purpose 

Though reprimands are used more frequently in classrooms than praise (Reinke et al., 
2013), recent research on the effectiveness of reprimands is inadequate. Although correlational 
studies have linked reprimands to variables such as disruptive behavior and reduced student 
engagement (Downs et al., 2019; McComas et al., 2017), limited studies have examined 


longitudinal data and causation. In this study, we used a cross-lag analysis to examine the effects 
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of teacher reprimands on future student behavior while controlling for teacher praise, given the 
potential association between teacher praise and student behavior. Four specific questions guided 
this research: 

1. Do teacher reprimands decrease future disruptive behavior of students at risk for EBD 
after accounting for past teacher reprimands and past student disruptive behavior? 

2. Does student disruptive behavior increase future teacher reprimands toward students 
at risk for EBD after accounting for past teacher reprimands and past student 
disruptive behavior? 

3. Do teacher reprimands increase future engagement of students at risk for EBD after 
accounting for past teacher reprimands and past student engagement? 

4. Does a lack of student engagement increase future teacher reprimands toward 
students at risk for EBD after accounting for past teacher reprimands and past student 
engagement? 

Method 

Settings and Participants 

Data for this study were collected from 19 elementary schools in Missouri, Tennessee, 
and Utah as part of a four-year randomized control trial (RCT) of a proactive classroom 
management program called Class-wide Function Related Intervention Teams (CW-FIT; Wills et 
al., 2010). Teachers were randomly selected to participate in the CW-FIT program (see Wills, 
Kamps, Caldarella, Wehby, & Swinburne-Romine, 2018, and Wills, Wehby, Caldarella, Kamps, 
& Swinburne Romine, 2018, for more information). However, treatment condition assignments 
were not a factor in this present study, as only baseline data were considered. Participants 


included 311 students identified as at risk for EBD (see Procedures section) and 149 teachers. 
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There were approximately two at-risk students per class. See Table 1 for participant demographic 
information. The average school free or reduced-price lunch percentage was 74.57% (SD = 
19.44). 

Procedures 

Researchers across the three sites met with respective local school districts to recruit 
schools to participate in the RCT. As schools were recommended as a good fit for the study, 
researchers presented an overview of the RCT to the school faculty and asked for teacher 
volunteers. After completing informed consent procedures as outlined by university and school 
district institutional review boards (IRBs), volunteer teachers completed a multi-step process for 
study inclusion. First, teachers identified the teaching subject they associated with the worst 
behavior problems and used the Systematic Screening for Behavioral Disorders (SSBD; Walker 
& Severson, 1992) Stage 1 to nominate students whom they considered to be at risk for EBD. 
These nominated students and their parents completed informed assent/consent procedures as 
outlined by the respective IRBs. Teachers then completed the Social Skills Improvement System 
(SSIS; Gresham & Elliott, 2008) on consented students to verify their at-risk status according to 
national norms. Finally, to reduce rating scale bias, researchers confirmed the at-risk status of the 
students by direct observation using the Multi-Option Observational System for Experimental 
Studies (MOOSES; Tapp, Wehby, & Ellis, 1995). 

In the fall of each year, researchers conducted five direct observations, on five different 
days, on each at-risk student over a period of two to three weeks before the intervention took 
place. Observations were typically conducted two times per week. However, in year | of the 
study, only three to four baseline data points were collected on some students. An additional 10 


observations took place during the intervention period (four to six months) when approximately 
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half of the students received the intervention and half served as a control. These intervention data 
are not reported in this article for considerations of clarity and readability. Data from the five 
baseline observations were analyzed for this study. 

Measures 

The SSBD is a gold-standard nationally normed screening measure for identifying 
students at risk for EBD. Stage | is a nomination process in which teachers study the definitions 
and examples of externalizing and internalizing behaviors, then consider all the students in their 
classroom and identify those who exhibit either or both behaviors. Once students are identified, 
the teacher rank orders the identified students according to the severity of behaviors. Stage | 
interrater agreement (Spearman’s rho) ranges between .82 and .94, and test-retest reliability 
ranges between .72 and .79 (Walker & Severson, 1992). 

The SSIS is a norm-referenced standardized social skills measure that includes social 
skills, problem behaviors, and academic scales. While teachers completed the entire 76-item 
measure, researchers looked at the Problem Behavior scale to verify students’ at-risk status 
according to national norms; students whose scores fell in the at-risk or higher ranges were 
considered as at risk. Internal consistency (alphas) on the SSIS scales ranges from .94 to .97 
(Gresham & Elliott, 2008). 

MOOSES is a handheld direct observation computer system that collects data for later 
analysis. MOOSES has been successfully used in various studies to collect data on individual 
students and teachers (Downs et al., 2019; Reinke et al., 2013; Wills, Wehby, et al., 2018). With 
MOOSES, researchers were able to record students’ disruptive behaviors and teachers’ 
reprimands using a frequency count while simultaneously recording students’ engagement as a 


duration event. Behavioral definitions are provided in the variables section. Behaviors were 
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coded as an occurrence any time they happened during the continual 15-minute observation. 
Observations of a specific student occurred at approximately the same time of day during the 
same subject (though it varied from teacher to teacher) for all five baseline data points. Students 
whose MOOSES engagement levels were below 75% or whose disruptive behaviors were above 
10 occurrences for a minimum of two baseline observation sessions were considered at risk, as 
similar characteristics have been found in other studies of behaviorally at risk students (see e.g., 
Kamps, Conklin, & Wills, 2015; Wills, Kamps, et al., 2018). 

Observer preparation for using the direct observation system included several steps; (a) 
studying the MOOSES definitions for the frequency and duration event codes, (b) coding videos 
of student behavior (previously scored by researchers) to 85% accuracy, and (c) observing 
student behavior in live non-study classrooms with a research coordinator until 85% accuracy 
was achieved. Observers included undergraduate and graduate students as well as researchers 
and research coordinators with masters or doctorate degrees. 

Variables 

This study focused on three target variables—teacher reprimands, student disruptive 
behavior, and student engagement—and their corresponding effects, after controlling for teacher 
praise. These variables were collected in 15-minute sessions using the MOOSES program. 

Teacher reprimands were defined as negative verbal comments directed toward the target 
student, or the group that included the target student. These comments included scolding, 
disapproving of student social or academic behavior, or using negative comments directing 
students to stop misbehavior, as well as redirection or warning of negative consequences by the 
teacher. For example, “Johnny, quit wasting time and get back to work’’, “Group three, start 


paying attention or your names are going on the board”, and “Stop bothering Kim” would count 
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as reprimands while “Try harder on your math worksheet; I know you can do better”, “This is 
incorrect”, and students being asked to “sit” when coming in from lunch are not recorded as 
reprimands. 

Student disruptive behaviors were defined as deliberate physical or verbal displays of 
inappropriate behavior. These included posturing, gestures, and verbal statements intended to 
provoke others or draw attention to self; inappropriate use of classroom materials; or behavior 
intended to annoy, pester, or make fun of another. Disruptive behavior was any action by the 
student that interfered with his/her classroom participation and/or the productive classroom 
activity of peers. For example, rocking in the desk chair, tapping pencils, tossing material at 
other students or around the classroom, popping gum loudly, talking out after specifically being 
forbidden by teacher instructions, verbally bothering or making fun of someone, threatening 
(“I’m going to cut you!”), protesting (“Hey, that’s not fair!”), or refusing teacher direction (“No, 
I won’t do it,” or “Make me!”’) would be considered disruptive behavior; while kneeling on a 
chair to reach the table or desk that is difficult to reach when sitting, asking a peer for a pencil or 
something related to assignment and then getting started on work right away, or whispering to 
self about instruction would not be coded as disruptive behavior. 

Student engagement behaviors were defined as a student appropriately working on the 
assigned/approved activity. Examples of student engagement included reading orally or silently 
as directed, answering questions, writing, and looking at or attending to the learning material 
and/or task. For example, when the student is reading out loud with the class when directed to do 
so, or quietly following along in the book, they would be engaged. If the student stares away 
from the teacher, a student responding, or instructional materials for more than five seconds, they 


would be disengaged. 
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The control variable of teacher praise was defined as a verbal statement that indicated 
approval of behavior over and above the evaluation of adequacy or acknowledgment of a correct 
response. Praise included requests for children to give themselves a pat, high five, etc. To be 
counted as a praise to the student, it must be a verbal praise statement to that student or to a small 
or large group inclusive of the student. Examples include “Billy, I like the way you did that 


”? 


sum!”’, “Everyone is sitting quietly, great!”, and “Team 3 is doing a great job of following 
directions and reading their books as I asked; excellent job!”. Non-examples include the teacher 
saying “Thank you” to the student as she collects an assignment, “I’ve got Johnny’s paper”, and 
giving a thumbs up to the student. 
Interobserver Agreement 

During the RCT, a second trained observer was present for approximately 26.9% of 
observation sessions. Interobserver agreement (IOA) was collected by methods outlined by 
MacLean, Tapp, and Johnson (1985) using a 5-second window around each frequency code 
found in a primary observer’s MOOSES code file. An agreement was scored on that code if the 
matching code was found in the second observer’s file within the same 5-second window. 
Percentages of total agreement were calculated for frequency counts of teacher reprimands and 
student disruptions using the formula [agreements + (agreements + disagreements)]| x 100. The 
duration of student engagement behavior was calculated with second-by-second reliability 
estimates using the same IOA formula. During the RCT, overall average IOA for teacher 


reprimands totaled 97% (SD = .12), student disruptive behaviors agreed at 95% (SD = .11), and 


student engagement was 98% (SD = 2.90). 
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Analytical Strategy 

One cross-lag model was run to isolate the causal effects of the variables of interest 
(teacher praise [as a control], teacher reprimands, student disruptions, and student engagement) 
as displayed in Figure 1. Cross-lag models have long been considered a better alternative than 
multiple regression in isolating causal relationships (Kenny, 1975). As the data is longitudinal, 
collected over two to three weeks, the theory states that we are controlling for any unobserved 
variables through the previous observations and the auto-lag. The cross-lags thus should be 
considered causal and understood as such (Kenny, 1975). Autoregressive cross-lagged models 
examining the association between the variables of interest (teacher praise [as a control], teacher 
reprimands, student disruptions, and student engagement) across five time points (at varying 
intervals) were estimated. All variables have cross-lags with all other variables in the model. By 
modeling the sequential reciprocal relationship of variables across multiple observation periods, 
this approach clarifies whether one variable is a leading or lagging indicator of the others. The 
model simultaneously estimates three different types of association pathways: autoregressive, 
cross-lagged, and concurrent. 

The autoregressive pathways estimated the association of teacher praise at time ¢ and at 
time ¢ + 1 (as a control), teacher reprimands at time ¢ and at time ¢ + 1, student disruptions at time 
tand at time ¢ + 1, and student engagement at time ¢ and at time ¢ + 1. The autoregressive 
pathways control for previous levels of the variable such that cross-lagged associations in our 
model focus on predicting change in the variable above previous levels. The cross-lagged 
pathways represent associations between teacher reprimands at time ¢ and student disruptions at 
time ¢ + 1; associations between student disruptions at time ¢ and teacher reprimands at time ¢ + 


1; and their respective associations with student engagement, and teacher praise (as a control) 
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across the same time points. Concurrent residual correlations between teacher reprimands, 
student disruptions, student engagement, and teacher praise (as a control) for each time point 
were also estimated. A more technical description of the model specification is included in the 
Appendix. This modeling approach helps test aspects of the operant framework assumption that 
reprimands will lessen future disruptive behavior. 

Time-invariant covariates were (a) site of implementation (b) student ethnicity (white, 
black, or other), and (c) teacher ethnicity (white, black, or other), while the time-varying 
covariate was the time of observation. The baseline cross-lagged model was estimated with time- 
varying and time-invariant covariates, and all autoregressive, cross-lagged, and concurrent 
pathways were free to vary across time. The independence of observations assumption was 
violated as students were nested within classrooms; thus, a random effect of the classroom was 
added to the model. The school was another level of potential clustering, but as we had a 
relatively small number of schools (NV = 19) from an analytic perspective, nesting at this level 
was not considered. The intraclass correlation coefficients (ICCs) of the variables of interest at 
the teacher level were moderate (approximately .35 across all time points and across all 
variables) and much lower at the school level (approximately .05 across all time points and 
across all variables) suggesting that nesting at the teacher level was necessary while nesting at 
the school level was not. The maximum likelihood with robust standard errors (MLR) using a 
sandwich estimator to correct for any non-normality in the data was used to estimate the 
parameters and standard errors (Yuan & Bentler, 2000). The large sample size also helps resolve 
any normality issues. Additionally, participants were students at-risk, which explains why a large 
spike of observations at zero was not seen. Missing data were handled via the full information 


maximum likelihood (FIML) because it is more effective than traditional methods (listwise 
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deletion, mean imputation) in handling missing data (Enders & Bandalos, 2001). All analyses 
were done in Mplus 8.4 (Muthén & Muthén, 1998-2017). 


Results 


Descriptive statistics for the variable of interest (teacher reprimands, student disruptions, 
student engagement, and the control variable of teacher praise) are shown in Table 2. There were 
no missing data on these variables of interest at Times 1 and 2, minimal missing at Time 3 
(0.60%), 14.79% missing at Time 4, and 28.62% missing at Time 5. Bivariate correlations of the 
cross-section of Time | between the variables of interest are found in Table 3. Teacher 
reprimands were positively correlated with student disruptions (7 = .34, p < .01) and student 
black ethnicity (r = .18, p < .01). Teacher reprimands were negatively correlated with student 
engagement (7 = -.16, p < .01), student white ethnicity (r = -.12, p < .05), grade level (7 = -.23, p 
<.01), and the Utah site status (7 = -.19, p < .01). Students disruptions were positively correlated 
with teacher white ethnicity (r = .12, p < .05) and negatively correlated with student engagement 
(r = -.30, p < .01), grade level (7 = -.20, p < .01), and the Utah site status (r = -.12, p< .01). 
Student engagement was positively correlated with praise (r = .17, p < .01) and the Utah site 
status (r= .21, p< .01) and negatively correlated with Missouri site status (7 = -.28, p < .01). 
Praise was not positively correlated with any variables but was negatively correlated with grade 
level (7 =-.11, p < .05). 

The results of the cross-lag model showing standardized results are reported in Table 4 
and illustrated in Figure 1. The auto-lags and cross-lags were freely estimated across time. Not 
shown are the controls of time-invariant covariates of student ethnicity, teacher ethnicity, grade 


level, nesting effect of teachers, site status, and the time-varying covariate of observation time. 
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Teacher Reprimands and Student Disruptions 

Teacher reprimands were weakly predictive of future teacher reprimands after controlling 
for teacher praise, except for Time 3 predicting Time 4 (see Figure 1), which was not entirely 
unexpected given the pattern of missing data as explained by the differences in the data 
collection across the years as discussed above. Disruptions were also weakly predictive of future 
disruptions across all time points. The R’ values for student disruptions were 7.60% for Time 1, 
22.60% for Time 2, 26.70% for Time 3, 25.00% for Time 4, and 28.50% for Time 5. The jump 
in R? from Time 1| to the other time points shows the strength of the cross-lag modeling approach 
where previous time points are accounted for allowing for stronger causal inferences to be made. 

Most of the cross-lags themselves were non-significantly predictive of future time points 
with the exception of teacher reprimands at Time | positively predicting student disruptions at 
Time 2 (6 = .13, p < .05), student disruptions at Time 3 positively predicting teacher reprimands 
at Time 4 (B = .21, p < .05), and teacher reprimands at Time 3 negatively predicting student 
disruptions at Time 4 (B = -.13, p < .05). These latter cross-lags have fewer causal implications 
because of the non-significant auto-lag of teacher reprimands between time points 3 and 4. The 
concurrent correlations between teacher reprimands and student disruptions were all positive, 
statistically significant, and small. Of note, the concurrent correlation at Time 1 was close but not 
the same as is shown in Table 3. This is to be expected as the concurrent correlations were 
estimated in the context of the cross-lag model. 
Teacher Reprimands and Student Engagement 

The last two research questions addressed whether teacher reprimands would affect 


student engagement (or the reciprocal) after controlling for teacher praise. In our analysis, 
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teacher reprimands had no significant cross-lags associated with student engagement or vice 
versa. These results are therefore not shown. 
Discussion 

Reprimands, often intended as a form of punishment, are used more often than praise in 
schools (Reinke et al., 2013; Van Acker et al., 1996). Despite many teachers’ tendencies to use 
them in response to student disruptive behavior (Hollingshead et al., 2016), reprimands have 
been linked to escape-motivated behaviors (Shores et al., 1993), aggression (Van Acker et al., 
1996), and further disruptive behavior (Downs et al., 2019). The use of reprimands for students 
with or at risk for EBD can be especially problematic, given the specific school challenges faced 
by these students (Conley et al., 2014; Hecker et al., 2014; Salle et al., 2018). Unfortunately, 
many students with EBD receive high rates of reprimands and low rates of praise from their 
teachers (Rathel et al., 2014; Sutherland & Wehby, 2001), though it would be beneficial for these 
students to receive fewer reprimands and more praise to improve their engagement and 
academics (Downs et al., 2019; Rathel et al., 2014). 

The current study found that teacher reprimands did not appear to decrease future 
disruptive behavior or increase future engagement for students at risk for EBD or vice versa. Our 
results support earlier assertions that reprimands do not result in long-term positive behavior 
change, though they may temporarily suppress misbehavior (Alber & Heward, 2000). This might 
be because reprimands do not directly teach students the skills needed to improve their behavior 
(Curran & IRIS Center, 2003; Taylor, Smiley, & Richards, 2009), and thus students may 
continue to exhibit negative behavior and continue receiving reprimands. Another problem is 
that reprimands are reactive: A student acts disruptively and a teacher reprimands the student. 


We agree with others who recommend effective teaching techniques and proactive behavior 
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management strategies (Simonsen, Fairbanks, Briesch, Myers, & Sugai, 2008; Taylor et al., 
2009) to decrease disruptions and increase engagement. It was also interesting that student 
misbehavior did not predict future teacher reprimands. This may be explained by the possibility 
that teachers are not reinforced for their reprimands, in that, as shown in the present study, 
reprimanding students has no lasting effects on student misbehavior. Also, while teacher 
reprimands were negatively correlated with student engagement, they did not predict future 
student engagement for these students at risk for EBD. A possible reason for this finding may be 
that teachers are more focused on reprimanding students who are disruptive rather on students 
who are disengaged, especially if such students are not disruptive to the classroom learning 
environment. Teachers may use different behavior management strategies for disengaged 
students such as reminding students of expectations or reinforcing peers who are engaged, 
though this finding needs additional study. 

The small correlations between teacher reprimands and student disruptions found in this 
study were somewhat unexpected. These correlations were expected to be larger, though there 
are many reasons why they may have been smaller. For example, the teacher may not catch all 
the disruptive behavior that an observer may see, the teacher may mistakenly reprimand the 
student, or the student may be disengaged but not be disrupting the class. It is also possible that a 
student could receive a group reprimand, because they were part of a group that was being 
disruptive, even though the student themselves was not disruptive. 

While not a focus of the study, our results suggest that as student grade level increases, 
teachers’ verbal interactions with students (1.e., reprimands and praise) tend to decrease, similar 
to results found by Reddy et al. (2013) in their study of elementary school classrooms. These 


results are concerning since research suggests that students with or at-risk for EBD benefit from 
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high rates of teacher praise and low rates of teacher reprimands (Downs et al., 2019; Rathel et 
al., 2014; Reinke et al., 2013). 

There were some other interesting findings from this study. Namely, the Utah site had 
significantly fewer teacher reprimands, student disruptions, and greater student engagement than 
the other sites. The Missouri site had significantly less student engagement than the other sites. 
Reasons for these site differences are unclear but may be due to cultural or demographic 
differences—further research would be needed to investigate these findings. In addition, there 
were patterns found regarding student and teacher minority status. White students were 
reprimanded significantly less (7 = -.12) than Black students or other students. Black students 
were reprimanded significantly more (7 = .18) than White students and other students. For 
teachers, there were more student disruptions if the teacher was White (7 = .12) than if the 
teacher was Black or Other. These results are like those of Scott, Gage, Hirn, and Han (2019) 
who found that both Black and White teachers provided significantly more negative feedback to 
Black students (than White students) regardless of their behavior, suggesting a need for 
interventions to address these differences. 

Limitations and Future Directions 

Though participant data were from an RCT, the sample size was relatively limited by 
observing and recording only students at risk for EBD, not all the students in the class. We 
analyzed the data from students at risk for EBD, as we hypothesized they would receive more 
reprimands than their peers, as indicated in the literature (Rathel et al., 2014; Sutherland & 
Wehby, 2001). Future studies would benefit from examining the teacher reprimands, student 


disruptions, and student engagement levels for all students in a class. 
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The models used in the current study did not control for other teacher behaviors that may 
confound future student disruptive behaviors. Student behavior may be maintained by other 
variables such as non-verbal reprimands, student teacher-relationships, or token economies. 
Several studies could be conducted to separately examine these variables. For example, 
observations could be conducted that examine non-verbal reprimands (disapproving looks, 
tickets, name written on board, hand signals, etc.), the effects of negative consequences (“clip 
down’, time out, lost recess time, principal’s office), and other variables (student-teacher 
relationship, teacher job satisfaction or burnout) on students’ disruptive classroom behavior. 

Additionally, the small predictive auto-lags, the power of the model, turned out to be a 
limitation, as we would expect the auto-lags to be more predictive from one time point to the 
next. However, this may be influenced by the varying numbers of days between observations, as 
data were not collected daily, neither were observations consistently spaced across the two- to 
three-week observational period. Another possibility for the weak auto-lags (especially between 
time points 3 and 4) is the increased missingness in the variables of interest that occurred as a 
feature of this study as discussed in the Method section. Future studies might find that data 
gathered daily will reveal stronger relationships between the auto-lags, as well as verifying 
whether the cross-lags are more predictive. Finally, data were only collected in elementary 
school settings. Replication of this study in secondary school settings would be beneficial. 
Implications and Conclusions 

Reprimands are meant to stop misbehavior. In the current study, teacher reprimands did 
not appear to help decrease future classroom disruptions or increase future engagement of 
students at risk for EBD. This should not be surprising, as harsh reprimands in schools have been 


associated with negative side effects such as anger, fear, escape, and avoidance (Sidman, 1989; 
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Walker, Ramsey, & Gresham, 2004) rather than improved student behavior. In addition to being 
harmful to teachers and their students, reprimands prove less effective than positive classroom 
behavioral management strategies (Reinke et al., 2013). Teachers who use reprimands also report 
higher levels of emotional exhaustion than their peers who do not (Reinke et al., 2013). Given 
the findings of the current study, along with those of previous researchers, we recommend that 
teachers replace reprimands with proactive classroom management strategies, such as clearly 
teaching classroom expectations, reinforcing positive student behavior, and using behavior- 
specific praise (Simonsen et al., 2008), as primary responses to student misbehavior and 


disengagement. 
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Table 1. Participant Demographic Data 


At-Risk Students (NV = 311) Teachers (N = 149) 
Frequency Percentage Frequency Percentage 

Grade Level 

Kindergarten 55 17.68% 27 18.12% 

18‘ Grade 58 18.65% 29 19.46% 

2™4 Grade 50 16.08% De 14.77% 

3™ Grade 66 21.22% = | 20.81% 

4't Grade 35 11.25% 20 13.42% 

5 Grade 36 11.58% 14 9.40% 

6" Grade 11 3.54% 6 4.03% 
Special Education Disability 

No 243 78.14% 

Yes 54 17.36% 

Missing 14 4.50% 
Ethnicity 

White/Caucasian 133 42.77% 124 83.22% 

Black/African American 124 39.87% 16 10.74% 

Hispanic/Latino 43 13.83% 4 2.68% 

Asian/Pacific Islander 1 0.32% 2 1.34% 

Other 4 1.29% 3 2.01% 

Missing 6 1.93% 0 0.00% 
Gender 

Male 225 72.35% f | 4.70% 

Female 86 27.65% 142 95.30% 
Experimental Condition 

Intervention 170 54.66% 78 52.35% 

Comparison 141 45.34% 71 47.65% 
Education Level 

Bachelor’s 65 43.62% 

Master’s 69 46.31% 

Other 6 4.70% 

Missing 8 5.37% 
Observed Subject 

Language Arts 86 57.72% 

Math 55 36.91% 

Social Studies 3 2.01% 

Science 2 1.34% 

Other 3 2.01% 


Teaching Experience M=9.20 years (SD = 9.04) 
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Table 2. Descriptive Statistics for Variables of Interest 


Time 1 Time 2 Time 3 Time 4 Time 5 


Teacher 443 256 238 2.56 220 227 246 267 237 2.67 
Reprimands 
_ Student i439 1267 14.65 11.70 15.90 14.11 15.71 12.98 16.46 14.33 
Disruptions 
Student 4940 22.74 67.94 22.84 6768 23.18 67.17 23.91 65.06 24.12 
Engagement 
Teacher 115 171 0.89 136 1.06 2.04 0.98 1.49 0.93 1.45 
Praise 
n a1 3131 309 265 23 
% missing 0.00% 0.00% 0.60% 14.79% 28.62% 


Note. Teacher Reprimands, Student Disruptions, and Teacher Praise are frequency counts per 15- 
minute interval. Student Engagement is a duration event during a 15-minute interval and is 
reported as a percentage. 
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Table 3. Time One Bivariate Correlations of Variables of Interest (N = 311) 
1 2 3 4 5 6 7 8 9 10 11 12 
1. Teacher 
Reprimands ENO 
Zope cot 34** 1.00 
Disruptions 
Sseudenl -16** -30** 1.00 
Engagement 
4. Teacher Praise .03 01 L7** — 1.00 
5. Student Ethnicity % 
(White) - 12 -.00 02 -.01 1.00 
6. Student Ethnicity <i a 
(Black) 18 .08 -.00 -.02 -.70 1.00 
7. Teacher Ethnicity _ ¥ oe he 
(White) .08 12 -.10 O01 .20 -.29 1.00 
8. Teacher Ethnicity 93 06 = 08S 07 -19** 29% 78** 1,00 
(Black) 
9. Grade Level -.23** -20** O01 -.11* 010 -.06 .03 02 1.00 
10. Utah (site) -.19** -J2**  D1** O01 33** A SSHE DDEE 23% *  D0** — 1.00 
11. Missouri (site) .09 07 -.28** -.00 -.01 ATE* 07 -.04 05 -.56** 1.00 
12. Tennessee (site) .10 05 .10 01 -.34** — 39** — - 3] 28** — -D27**  - Agee _ SO** 1.00 
Note. * p< .05, ** p< .01 
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Table 4. Standardized Concurrent and Cross-Lagged Paths as Produced by the Model 


Disrupt* 
Time | 


Disrupt* 
Time 2 


Disrupt* 
Time 3 


Reprimands*® 
Time | 


Reprimands*® 
Time 2 


Reprimands*® 


Time 3 


Reprimands*® 
Time 4 


Reprimands*® 
Time 5 


d 


Praise® Time 1 
Praise® Time 2 
Praise® Time 3 


Praise® Time 4 


Praise® Time 5 


Disrupt* Disrupt? Engage 

Time4 Time5_ Time 1 

-- -- -0.15** 
-0.13* -- -- 
0.40** 0.11 -- 
-- 0.31** -- 

-- -- 0.19** 
0.02 -- -- 
0.13* 0.11 -- 
-- -0.04 -- 


Engage? 


Time 2 


-0.01 


-0.16** 


Engage? 
Time 3 


33 


0.06 


-0.22** 


0.08 
0.12 


Note: All bolded diagonal values are concurrent paths or correlation coefficients estimated by the model. All other 


values are cross-lags or standardized betas. Model controlled for grade level, site, student ethnicity, teacher 


ethnicity, the nesting effect of teachers, and time of observation. -- = not applicable. 
‘Student disruptions. "Student engagement. ‘Teacher reprimands. ‘Teacher praise. 
* np < 0.05, ** p< 0.01 
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Teacher Teacher Teacher Teacher Teacher 
Reprimands 3 Reprimands Reprimands Reprimands : Reprimands 
(Time 1) (Time 2) (Time 3) (Time 4) (Time 5) 


Ss 
3 
&. Cross-lags 


.31**(.06) 


Student Student 47**(,06) Student Student Student 
Disruptions Disruptions - Disruptions Disruptions Disruptions 
(Time 1) (Time 2) (Time 3) (Time 4) (Time 5) 


Figure 1. Teacher reprimands and student disruptions cross-lag model. Concurrent paths are correlation coefficients estimated by the 
model. The auto-lags and cross-lags are standardized betas. (.xx) refers to the standard error. Model controlled for grade level, site, 
student ethnicity, teacher ethnicity, teacher praise, the nesting effect of teachers, and time of observation. Dashed paths are not 
significant. To improve readability, student engagement and teacher praise auto-lags and cross-lags (while included in the model) are 
not shown. * p< .05, ** p<.01. 


EFFECTS OF TEACHER REPRIMANDS 35 


Appendix 
This paper uses an autoregressive cross-lag model to understand the relationships of 
teacher reprimands, student disruptive behavior, and student engagement. This is a very brief 
explanation of the purpose and rationale for using the cross-lag model. Readers interested in an 
in-depth exploration of this model are encouraged to read the work of Kenny (1975). The general 
model has the following form where Y;i and X; are ith student disruptions and teacher reprimands 
at time ¢, respectively. 


Yti= Boy + AyYeeni + BrXtepi + Sti 


Xti= Box t+ XXepi + ByYepi + ei 
Y(-i and X¢-1i are those same scores but recorded at time ¢ - 1. The Ay and Ax terms are the 
autoregressive lags of the scores at the previous time point. As these terms are included in the 
model, greater confidence in the lack of bias of the cross-lag parameters (Bx and By) can be given. 
These cross-lag parameters are estimates of which variable causes change in the other. If Bx is 
significant, then there is evidence that teacher reprimands lead to student disruptions as it 
determines part of the variance of future student disruptions. The 6, and &i terms are the error 


terms for student disruptions and teacher reprimands at time ¢. 


